Specification 
' Title of the Invention 

Portable Radio Communication Terminal and 
Expression Style Processing Method Therefor 

5 

Rackaround of The Invention 

The present invention relates to a portable 
radio communication terminal and expression style 
processing method and, more particularly, to a portable 

10 radio communication terminal which generates and edits 
an expression style format for expressing image data or 
character data in a desired format, and an expression 
style processing method. 

Recent portable radio communication terminals 

15 receive multimedia contents including various kinds of 
digital data such as character data, image data, and 
voice data from an information providing system such as 
home pages on the Internet and display the contents. A 
content of this type is expressed using an expression 

20 style format formed from a description language such as 
the HTML (HyperText Markup Language) or step SMIL 
(Synchronized Multimedia Integration Language) . A 
portable radio communication terminal displays a 
multimedia content on the basis of this expression style 

25 format. Processing of such an expression style format 
is called style processing. 

Style processing in a conventional portable 
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radio communication terminal will be described below 
with reference to Fig. 16. Referring to Fig. 16, a 
conventional portable radio communication terminal 
comprises a radio section 108 for performing radio 
5 communication with the radio base station of a portable 
telephone system, a transmission/reception data 
processing section 109 for executing communication 
protocol processing for radio communication, a display 
processing section 113 for executing display processing 
10 of character/image data, a display device 114 for 

displaying display data from the display processing 
section 113, a description language memory 116 for 
storing a description language such as the HTML or XML 
(extensible Markup Language) , an image memory 117 for 
15 storing image data, a voice data memory 125 for storing 
voice data, a voice playback processing section 123 for 
executing voice playback processing, a speaker 124 for 
converting the output from the voice playback processing 
section 123 to an audible signal, and a CPU (Central 
20 Processing Unit) 126 for controlling the entire portable 
radio communication terminal. 

Fig. 17 shows style processing by the portable 
radio communication terminal shown in Fig. 16. Object 
acquisition operation and display operation will be 
25 described. Referring to Fig. 17, in accordance with an 
instruction for download from a home page or file server 
by user operation (step S201) , when the target of the 
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download instruction is voice data, the designated voice 
data is downloaded (step S202) and stored in the voice 
data memory 125 (step S203) . When the target of the 
download instruction is image data, the designated image 
5 data is downloaded (step S204) and stored in the image 
memory 117 (step S205) . 

When the target of the download instruction is 
a description language, the designated description 
language is downloaded (step S206) and stored in the 

10 description language memory 116 (step S207), and then, 

the description language is analyzed (step S208) . After 
the end of the download instruction by user operation, 
if the description language is a description language 
with style such as the HTML style sheet or step SMIL, 

15 the character/image data is displayed on the display 

device 114, and the voice data is processed by the voice 
playback processing section 123 and played back from the 
speaker 124 (step S209) . 

However, the above-described conventional 

20 portable radio communication terminal executes only 

simple style processing and therefore has the following 
problem. 

As the first problem, since the style 
designation is fixed by the content provider, the user 
25 of the portable radio communication terminal cannot 

freely generate a content. As the second problem, since 
an operation of automatically browsing a content without 
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style designation in the terminal is impossible, the 
same user operation is required to reconstruct the same 
content, resulting in cumbersomeness . As the third 
problem, since a plurality of image data are separately 
5 prepared and synthesized by style description for every 
display, this scheme is unsuitable for a portable radio 
communication terminal with a limited memory. 

As a method of customizing the service 
providing method, a technique of issuing an instruction 
10 from a portable radio communication terminal to a server 
is disclosed in Japanese Patent Laid-Open No. 9-223062. 
However, according to this method, customization must be 
instructed from the terminal to the server every time, 
and the user cannot customize the service providing 
15 method by operating only the portable radio terminal. 

Techniques of generating a content having a 
desired layout using a relatively large-scaled 
information processing apparatus such as a personal 
computer have been proposed in Japanese Patent Laid-Open 
20 Nos. 910-222508, 11-96144, and 11-238053. However, 
these techniques do not assume a portable radio 
communication terminal having a limited memory capacity. 
.gumma ry of the Invention 

It is an object of the present invention to 
25 provide a portable radio communication terminal capable 
of using various kinds of multimedia contents in a 
desired format, and an expression style processing 
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method thereof. 

In order to achieve the above object, 
according to the present invention, there is provided an 
expression style processing method for a portable radio 
5 cornmunication terminal which transmits/receives a 
multimedia content formed from an object having 
character data, image data, or voice data through a 
network including a radio data communication network, 
comprising the steps of storing a plurality of objects, 
10 generating an expression style format for expressing the 
stored objects, and storing the generated expression 
style format. 

Rr-ief nescr iption of the Drawings 

Fig. 1 is a block diagram of a radio 
15 communication system to which the present invention is 
applied; 

Fig. 2 is a block diagram of a portable radio 
communication terminal according to the first embodiment 
of the present invention; 
20 Fig. 3 is a flow chart showing style 

processing operation by the portable radio communication 
terminal shown in Fig. 2; 

Fig. 4 is a flow chart showing another style 
processing operation by the portable radio communication 
2 5 terminal shown in Fig. 2; 

Fig. 5 is a flow chart showing still another 
style processing operation by the portable radio 
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communication terminal shown in Fig. 2; 

Fig. 6 is a block diagram of a portable radio 
communication terminal according to the second 
embodiment of the present invention; 
5 Fig. 7 is a flow chart showing style 

processing operation by the portable radio communication 
terminal shown in Fig. 6; 

Fig. 8 is a flow chart showing another style 
processing operation by the portable radio communication 
10 terminal shown in Fig. 6; 

Fig. 9 is a block diagram of a portable radio 
communication terminal according to the third embodiment 
of the present invention; 

Fig. 10 is a flow chart showing style 
15 processing operation by the portable radio communication 
terminal shown in Fig. 9; 

Fig. 11 is a flow chart showing another style 
processing operation by the portable radio communication 
terminal shown in Fig. 9; 
20 Fig. 12 is a flow chart showing still another 

style processing operation by the portable radio 
communication terminal shown in Fig. 9; 

Fig. 13A is a perspective view of the portable 
radio communication terminal of the present invention: 
25 Fig. 13B is a plan view of a key pad shown in 

Fig. 13A; 

Figs. 14A and 14B are views showing window 
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display representing expression style format 
registration operation; 

Fig. 15 is a view showing a generated 
expression style format; 
5 Fig, 16 is a block diagram of a conventional 

portable radio communication terminal; and 

Fig. 17 is a flow chart showing style 
processing by the portable radio communication terminal 
shown in Fig. 16. 

10 nescription of the Preferred Embodiments 

The present invention will be described below 
in detail with reference to the accompanying drawings. 

Fig. 1 shows a radio communication system to 
which the present invention is applied. Referring to 

15 Fig. If a portable radio communication terminal (to be 
referred to as a portable terminal hereinafter) 1 as a 
radio communication terminal is connected to a portable 
telephone packet network 2 to receive a content 
described in a description language such as the HTML or 

2 0 XML and published to a home page server 3 on the 

portable telephone packet network 2 or to a home page 
server 6 on the Internet 5. An expression style format 
and object generated by the portable terminal 1 are 
transmitted/received to/from mail servers 4 and 7. 

25 Fig. 2 shows the portable terminal according 

to the first embodiment of the present invention. 
Referring to Fig. 2, the portable terminal 1 shown in 
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Fig. 1 comprises a radio section 8 for performing radio 
communication with the radio base station of a portable 
telephone system, a transmission/reception data 
processing section 9 for executing communication 
5 protocol processing for radio communication, an image 
input section 11 such as a camera for inputting image 
data, an image processing section 10 for processing 
image data input from the image input section, a 
character input section 12 for inputting characters, a 

10 display processing section 13 for executing display 

processing of character/image data, a display device 14 
for displaying output data from the display processing 
section 13, a description language memory 16 for storing 
a description language such as the HTML or XML, an image 

15 memory 117 for storing image data, an expression style 

format memory 18 for storing an expression style format, 
an external I/F section 15A serving as an interface for 
exchanging various data with an external device such as 
a camera, personal computer, or memory card, and a CPU 

20 15 for controlling the entire portable terminal 1. 

These components are connected to each other through an 
internal bus BUS. 

The CPU 15 has, as functional processing 
sections constructed by programs, an expression style 

25 format generation section 31 for generating an 

expression style format for arbitrarily expressing 
objects stored in various memories, a description 



language processing section 32 for converting characters 
input from the character input section 12 to digitally 
processible character data, and an expression style 
format correction section 33 for changing the expression 
5 format of an arbitrary object registered in the 

expression style format stored in the expression style 
format memory 18 to correct the expression style format. 

The expression style format used in this 
embodiment may be included in a character information 

10 description language such as the HTML style sheet or 
' SMIL. Alternatively, an expression that describes only 
a style separately from an object may be selected. 
Those who are skilled in the art recognize the HTML 
style sheet or SMIL very well. Its structure is 

15 irrelevant to the present invention, and a detailed 
description thereof will be omitted. 

Style processing operation by the portable 
terminal 1 shown in Fig. 2 will be described next with 
reference to the flow chart shown in Fig. 3. Referring 

20 to Fig. 3, object generation operation and expression 
style format generation operation will be described as 
style processing. 

First, an object such as characters or image 
is generated as an expression target under the control 

25 of the CPU 15 (step SI) . To sense an image in this 

object generation processing, an image is sensed by the 
image input section 11 (step 82) . The obtained image is 
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converted to digitally processible image data by the 
image processing section 10 (step S3) and stored in the 
image memory 17 (step S4) . As image sensing in step S2, 
not only sensing with the camera but also an image read 
with an image scanner or data transfer from a detachable 
memory or another terminal can be done. 

When characters are input in step SI, the 
description language processing section 32 converts the 
characters input from the character input section 12 to 
a description language such as the HTML (steps S5 and 
S6) and stores the description language in the 
description language memory 16 (step 87). 

After object generation is ended, the 
expression style format generation section 31 generates 
expression style format data (step 88). When style data 
is reset in step S8, data stored in the expression style 
format memory 18 is erased (step S9) . When image data 
display is selected by user operation, the designated 
image data is displayed from image data stored in the 
image memory 17 (step SIO) . The name of the displayed 
image data is stored in the expression style format 
memory 18 as expression style format storage data (step 
Sll) . 

When character display is selected by user 
operation in step SB, the characters stored in the 
description language memory 16 are displayed (step S12) . 
The name of the displayed character data, e.g., the name 



of the description language file is stored in the 
expression style format memory 18 as expression style 
format storage data (step S13) . With this user 
operation, the selected and displayed contents and the 
5 order thereof are stored as an expression style format, 
thus expression style format data as data for 
reconstructing expression is completed. When display of 
the image and characters is ended by user operation, 
registration of expression style format data is ended 
10 (step S14) . When "return" is selected in step S8, the 

flow returns to object generation processing in step SI. 

Another style processing operation by the 
portable terminal 1 shown in Fig. 2 will be described 
with reference to the flow chart shown in Fig. 4. 
15 Referring to Fig. 4, content reconstruction operation 

based on expression style format data will be described 
as style processing. 

The CPU 15 reads out an expression style 
format from the expression style format memory 18 (step 
20 S21) and determines whether the expression style format 
is to be corrected (step S22) . If YES in step S22, the 
expression style format correction section 33 corrects 
the expression style format (step S23) . If NO in step 
S22, the expression style is instructed by user 
25 operation (step S24) . Thus reconstruction operation 
based on the expression style format starts. 

In step S24, under the control of the CPU 15 
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functioning as an expression processing means, 
corresponding processing is instructed in accordance 
with the instruction order of the expression style 
format. When image display is instructed, the 
5 designated image data is read out from the image memory 
17 (step S25) and displayed on the display device 14 
through the display procession section 13 (step S26) . 
When character display is instructed, the designated 
character data is read out from the description language 

10 memory 16 (step S27) and displayed on the display device 
14 through the display procession section 13 (step S28) , 
When the read from the expression style format memory 18 
is ended, the style processing is ended. 

Still another style processing operation by 

15 the portable terminal 1 shown in Fig. 2 will be 

described next with reference to the flow chart shown in 
Fig. 5. Referring to Fig. 5, expression style format 
correction operation will be described as style 
processing. 

20 First, an expression style format is read out 

from the expression style format memory 18 (step S31) . 
The expression style format correction section 33 
corrects the style in accordance with user operation 
(step S32) . To correct an image display position in 

25 step S32, the display position for each image is 

designated by user operation (step S33) . To correct the 
image display order, the display order of each image is 
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designated by user operation (step S34) . To correct the 
image display size, the display size of each image is 
designated by user operation (step S35) . After the 
correction operation, the designated expression style 
5 format is changed and registered (step S36) . When all 
style corrections are ended, the changed and registered 
expression style format is stored in the expression 
style format memory 18 (step S37). Note that the image 
display order includes designation of superposition 

10 order for superposed display. 

According to this embodiment, since not only 
an expression style format of multimedia information is 
generated on the content provider side but also the 
expression style format can be freely generated and 

15 processed on the terminal side, a customized content can 
be generated using the style. In addition, the 
generated content expression style format can be 
transmitted to a third party in cooperation with 
electronic mail. 

20 Fig. 6 shows a portable terminal according to 

the second embodiment of the present invention. In this 
embodiment, an object to be displayed is acquired from, 
e.g., a home page connected to a radio network. 

Referring to Fig. 6, a portable terminal lA is 

25 different from the portable terminal 1 shown in Fig. 2 
in that the image processing section 10, image input 
section 11, and character input section 12 which are 
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used to generate an object are omitted, and instead, a 
download processing section 34 with which a CPU 19 
downloads character data, a description language, image 
data, or voice data through a network is prepared. In 
5 this embodiment, instead of generating an object on the 
terminal side, an object is acquired from a home page or 
mail through the Internet by a radio section 8 and 
transmission/reception data processing section 9. 

Style processing by the portable terminal 
10 shown in Fig. 6 will be described next with reference to 
the flow chart shown in Fig. 7. Referring to Fig. 7, 
expression style format correction operation will be 
described as style processing. 

When the start of registration of an 
15 expression style format is instructed by user operation 
(step S41) , the download processing section 34 executes 
download from a home page or file server (step S42) . In 
step S42, when the target of the download instruction is 
image data, the designated image data is downloaded 
20 (step S43) and stored in an image memory 17 (step S44) . 
The downloaded image data is displayed on a display 
device 14 (step S45) . The name of the image data is 
additionally registered in an expression style format 
memory 18 as an expression style format (step S50) . 
25 When the target of the download instruction is 

a description language, the designated description 
language data is downloaded (step S46) , stored in a 



- 14 - 



description language memory 16 (step S47), and analyzed 
(step S48) . The analysis result is displayed on the 
display device 14 (step S49) . The name of the 
description language is additionally registered in the 
expression style format memory 18 as an expression style 
format (step S50) . When the download instruction is 
ended by user operation, registration in the expression 
style format memory 18 is ended (step S51) . 

Another style processing operation by the 
portable terminal lA shown in Fig. 6 will be described 
next with reference to the flow chart shown in Fig. 8. 
Referring to Fig. 8, image data storage operation for an 
acquired object will be described as style processing. 

In accordance with an instruction by user 
operation, the download processing section 34 downloads 
expression style format data from a home page or file 
server and registers the downloaded expression style 
format data in the expression style format memory 18 
(steps S61 to S69) . These operations are the same as in 
steps S42 to S50 in Fig. 7, and a detailed description 
thereof will be omitted. When the download instruction 
is ended by user operation, superposed image data is 
extracted as an expression style format, generated as 
new image data, and stored in the image data memory 
(step S70) . Each of the superposed image data is 
deleted from the image memory 17 (step S71) . 

According to this embodiment, since the 



expression style format can be freely generated and 
worked on the terminal side using an object from the 
content provider side, a customized content can be 
generated using the style. In addition, the generated 
5 content expression style format can be transmitted to a 
third party in cooperation with electronic mail. 
Furthermore, since a plurality of window data can be 
synthesized into one window data, necessary information 
can be stored even by a terminal such as a portable 

10 telephone having a limited memory capacity. 

Fig. 9 shows a portable terminal according to 
the third embodiment of the present invention. In this 
embodiment, voice data such as a voice is attached as 
part of an object. 

15 Referring to Fig. 9, a portable terminal IB 

has, in addition to the arrangement of the portable 
terminal 1 shown in Fig. 2, a voice input section 22 for 
inputting a voice, a voice processing section 21 for 
converting a voice to digitally processible voice data, 

20 a voice data memory 25 for registering voice data, a 

voice playback processing section 23 for executing voice 
playback processing, and a speaker 24. A CPU 20 has a 
download processing section 34, like the portable 
terminal lA shown in Fig. 6. 

25 Style processing operation by the portable 

terminal IB shown in Fig. 9 will be described next with 
reference to the flow chart shown in Fig. 10. Referring 
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to Fig. 10, object generation operation and expression 
style format generation operation will be described as 
style processing. 

The CPU 20 performs object generation 
5 operation in accordance with user operation (step S81) . 
In step S81, when the start of voice recording is 
instructed as the object generation operation, a voice 
is recorded by the voice input section 22 (step S82) . 
The recorded voice is converted to digital voice data by 

10 the voice processing section 21 (step S83) . The voice 
data is stored in the voice data memory 25. 

In generating expression style format data 
(step S91) , the voice data is designated by an 
instruction for the start of voice playback, read out 

15 from the voice data memory 25, and played back from the 
speaker 24 through the voice playback processing section 
23 (step S93) . The voice data is additionally 
registered in an expression style format memory 18 as 
expression style format data (step S94). When "return" 

20 is selected in step S91, the flow returns to object 
generation processing in step S81. 

Processing of generating an object such as 
characters or an image (steps S85 to S90) , reset 
processing for stored expression style format data (step 

25 S92) , expression style format data generation processing 
based on the generated object (steps S95 to S98), and 
registration processing of the generated expression 
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style format data (step S99) are the same as in steps S3 
to S8 and SIO to S15 in Fig. 3, and a detailed 
description thereof will be omitted. 

Another style processing operation by the 
5 portable terminal shown in Fig. 9 will be described next 
with reference to the flow chart shown in Fig. 11. 
Referring to Fig. 11, reconstruction operation based on 
expression style format data will be described as style 
processing. 

10 First, the CPU 20 reads out an expression 

style format from the expression style format memory 18 
(step SlOl) and determines whether the expression style 
format is to be corrected (step S102) . If YES in step 
S102, an expression style format correction section 33 

15 corrects the expression style format (step S103) . If NO 
in step S102, the expression style is instructed by user 
operation (step S104) . Therefore, reconstruction 
operation based on the expression style format starts. 

In step S104, when the instruction of the 

20 expression style format read out from the expression 

style format memory 18 is voice playback, the designated 
voice data is read out from the voice data memory 25 
(step S105) and played back from the speaker 24 through 
the voice playback processing section 23 (step S106) . 

25 Reconstruction operation according to an image display 

instruction or character display instruction (steps S107 
to SllO) are the same as in steps S22 to S25 in Fig. 4, 
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and a detailed description thereof will be omitted. 

Still another style processing operation by 
the portable terminal IB shown in Fig. 9 will be 
described next with reference to the flow chart shown in 
5 Fig. 12. Referring to Fig. 12, object acquisition 
operation and expression style format generation 
operation will be described as style processing. 

When the start of expression style format 
registration is instructed by user operation (step Sill) , 

10 the download processing section 34 starts downloading 

from a home page or file server in accordance with user 
operation (step S112). 

In step S112, when the target of the download 
instruction is voice data, the designated voice data is 

15 downloaded (step S113) . The downloaded voice data is 
stored in the voice data memory 25 (step S114) and 
played back from the speaker 24 through the voice 
playback processing section 23 (step S115) . Next, the 
name of the voice data is additionally registered in the 

20 expression style format memory 18 (step S123) . 

Processing operation of downloading image data or a 
description language (step S116 to S123) and 
registration processing operation (step S124) are the 
same as in steps 839 to S45 and 847 in Fig. 7, and a 

25 detailed description thereof will be omitted. 

The portable terminal of the present invention 
will be described next in more detail. 

- 19 - 



As shown in Fig. 13A, the portable radio 
terminal of the present invention has a display section 
35 such as an LCD on which characters, graphic patterns, 
and images are displayed by dot matrices, and a key pad 
5 36 with which characters or various operations are input. 
As shown in Fig. 13B, the key pad 36 comprises dial keys 
36a capable of inputting kanas, symbols, and alphabets 
by combining number inputs, and function keys 36b 
including a menu key, cursor keys, and enter key, and is 

10 used for expression style format registration operation. 

The expression style format registration 
operation will be described next with reference to 
Figs. 14A and 14B. When the menu key is pressed in a 
standby window displayed in a standby state, a menu is 

15 displayed (window A). When "3. browser" is selected in 
the window A, communication with the home page server 3 
or 6 starts through the portable telephone packet 
network 2 or Internet 5, and a home page registered in 
advance is displayed (window B) , The window can be 

20 shifted to a desired home page by operating the browser 
using the key pad 36. 

When the menu key is pressed, a browser menu 
is displayed (window C) . When "4. register additional 
URL style" is selected in the window C, the URL of a 

25 desired home page that is currently being displayed by 
the browser is additionally registered as a style, and 
the home page is displayed (window B) . 
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When "3. style" is selected in the window C, a 
style menu is displayed (window D) . When "1. register 
new style" is selected in the window D, registration 
processing of a new expression style format is started, 
5 and a new style registration window is displayed (window 
E) . 

To add character data to the style, "1. add 
character data" is selected in the window E. A style 
character additional registration window is displayed, 

10 and a list of files which store character data in 
advance is displayed (window F) . When a file B is 
selected in the window F by moving the cursor with the 
cursor keys (window G) and then the enter key is pressed, 
the contents of the file B are displayed in the window 

15 (window H) . After this, the display position is 

determined by operating the cursor keys. For example, 
when the " i " key is pressed five times, the display 
position moves downward (window I) . When the display 
position is determined, and in this state, the enter key 

20 is pressed, the designated character file is 

additionally registered as a style, and the window 
returns to the window E. 

To add image data to the style, "2. add image 
data" is selected in the window E. Thus the style 

25 character additional registration window is displayed, 

and a list of files which store image data in advance is 
displayed (window J) . When a file BB is selected in the 
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window J by moving the cursor with the cursor keys 
(window K) and then the enter key is pressed, the 
contents of the file BB are displayed in the window 
(window L) . After this, the display position is 
5 determined by operating the cursor keys. For example, 
when the " i " key is pressed three times, and the "— 
key is pressed three times, the display position moves 
to the lower right side (window M) . When the display 
position is determined, and in this state, the enter key 
10 is pressed, the designated image file is additionally 
registered as a style, and the window returns to the 
window E. 

To confirm the operation of the registered 
style, "9. return" is selected in the window E to return 

15 the display to the window D. The contents of the 

registered style operation can be confirmed by selecting 
"3. operate style" in the window D. In this style 
example, the image data of an image file A is displayed 
in a first window N. A next window O is displayed by 

20 pressing the key, and only the character string of 

the file A is displayed. Subseguently , only the 
character string of the file B is displayed as in a 
window P by pressing the "— ^" key. When the " i " key is 
pressed in this state, the image data of the image file 

25 BB and the character string of the file B are displayed 
in a window Q while being superposed. When the menu key 
is pressed in the window Q, a window R is displayed. 
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When "0. return" is selected in the window R, the 
display returns to the window D. 

Such an expression style format is defined by 
a description language inserted between BEGIN: STYLE and 
5 END: STYLE, as shown in Fig. 15. A name is described in 
TITLE: as the name of STYLE. The expression unit of 
each object is defined as BODY. Individual objects 
simultaneously expressed are described between 
BEGIN: BODY and END: BODY. 

10 Fig. 15 shows three BODIES as examples. The 

object of the first BODY comprises characters "ABC". 
The display position and font size are defined. The 
object of the second BODY comprises superposed image 
data with file names A and B. The image data with the 

15 file name A is superposed on that with the file name B. 
The object of the third BODY comprises character data 
with a file name ABC, superposed image data with file 
names C and D, and voice data with a file name step SA. 

As has been described above, according to the 

20 present invention, since not only an expression style 
format of multimedia information is generated on the 
content provider side but also the expression style 
format can be freely generated and processed on the 
terminal side, the user on the terminal side can 

25 arbitrarily generate a customized content. In addition, 
the generated content expression style format can be 
transmitted to a third party in cooperation with 
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electronic mail. 
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